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Thri^ Dimftpaioniil Displiiv Mf>thnd. Wi>m And Anni>ri>Hi« 
RELATED APPLICATIONS 

lOOOll This application claims benefit from U.S. Provisional Patent Application 60/487.267 filed 
July 16, 2003 and fh>m Canadian Patent Application 2,449,982 filed November 18, 2003 and the 
contents of both of these applications are incorporated herein by reference. 

FIELD OF THE INVENTION 

100021 The present invention relates to display systems. More specifically, the present invention 
relates to display methods, systems and apparatus which exploit the human visual perceptual system to 
provide images on two dimensional image displays which are perceived by viewers as being three 
dimensional images. 

BACKGROUND OF THE INVENTION 

10003] Many attempts have been made in the past to provide two dimensional displays which 
appear to be three dimensional. In Victorian times, stereophotographs were very popular. These 
images were produced with a binocular camera that made two images of the object being photographed, 
each image's perspective being spaced firom the other. When viewed with a stereopticon, which is a 
device that shows each of the viewers* eyes the appropriate one of the two images, a thi'ee dimensional 
image is perceived by the viewer. 

[0004] In addition to stereophotographs, three dimensional motion pictures have been created 
wherein the members of the audience wear glasses, with right and left lenses either of two different 
color filters or with polarizing lenses having tsvo different polarizing angles, and two motion pictures 
with slightly different perspectives are simultaneously projected onto the screen through filters 
complementary to the lenses in the glasses. This results in one eye of each audience member seeing one 
of the projected films and the second eye seeing another of the projected films, and the different 
perspectives of the films result in a perception by the audience members of a three dimensional display. 
(0005] Both stereophotographs and three dimensional motion pictures suffer fit>m disadvantages in 
that they require their viewers to use special hardware, the stereopticon or filter glasses, to view the 
image. 

10006] Another method of making a viewer perceive a three dimensional image fix)m a two 
dimensional display is to employ the Pulfiich Effect, invented by Carl Pulfirich and published in Die 
Naturwissenschaften^ in the June through September 1922 issues. The Pulfiich Effect makes use of an 
inherent effect of the human visual perception system. Specifically, a very daric filter is placed over one 
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eye of the viewer who then observes a displayed object moving back and forth horizontally across a two 
dimensional display. Due to latency in how the human brain processes low light images relative to 
normally lit images, the viewer perceives the displayed object as moving into and out of the two 
dimensional display. While interesting, the Pulfrich Effect has limited practical applications and still 
requires special observer hardware, in this case one daiic filter. 

(00071 Another technique for providing a three dimensional image from a two dimensional display 
is the hologram. In holography, an image is captured as an interference pattern at the film. Coherent 
light from a laser is reflected from an object to be imaged and is combined at the film with light from a 
reference beam. Holograms enable the viewer to view a true three-dimensional image which exhibits 
parallax. 

(0008] Unfortunately, holograms also suffer from disadvantages in that they are difficult to create 
and display and are unsuited for video, motion pictures or the like. Also, holograms have constrained 
angles over which they can be viewed. Further, while they do produce accurate three dimensional 
images of objects, the color and appearance of the resulting image is not lifelike. 
(00091 A method, system and apparatus which permits the relatively easy creation and display of 
video images which are perceived by viewers as three dimensional displays, without requiring the 
viewers to use any special hardware, is desired. 

SUMMARY OF THE INVENTION 

(00101 It is an object of the present invention to provide a novel system, method and apparatus of 
creating and displaying two dimensional displays that are perceived as three dimensional displays. 
(001 1] According to a first aspect of the present invention, there is provided a method of creating a 
final image which, when displayed at a target location, is perceived by viewers as being three 
dimensional, comprising the steps of: (i) selecting a target location for the display at a display site; (ii) 
capturing video of at least one object to be displayed in the final image, the at least one object moving 
in the video at a necessary perceptual speed by translating generally along a plane extending through the 
eyes of expected viewera and/or rotating generally about an axis perpendicular to said plane; (iii) 
displaying the final image at the site onto a transparent screen positioned such that the final image 
appears at the target location in front of a background and such that the movement of the at least one 
object at the perceptual speed occurs. 

(00121 Preferably, for rotation of the at least one object, die perceptual speed is in die range of fiom 
about 0.8% to about 10% of the size of the at least one object, and more preferably the perceptual speed 
is in the range of fit>m about 1% to about 8% of the size of the at least one object and yet more 
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preferably the perceptual speed is in the range of from about 3% to about 5% of the size of the at least 
one object. Preferably^ for translation of the at least one object, the perceptual speed is in the range of 
from about 3% to about 12% of the size of the at least one object and more preferably the perceptual 
speed is in the range of from about 4% to about 6% of the size of the at least one object. 
10013] Also preferably, the method of the present invention further comprises the step of, prior to 
step (ii), surveying the display site to identify and characterize light sources and objects which would 
result in visual highlights on a object displayed at the target location and in step (ii) the video of the at 
least one object to be displayed is captiued under a recreation of the characterized light sources and 
objects surveyed at the target location. 

10014] According to another aspect of the present invention, there is provided a system for 
displaying on a two dimensional display at a target location a final image of at least one object, the final 
image being perceived by viewers as a three dimensional image, comprising: a transparent screen onto 
which the final image is displayed allowing a background behind said screen to also be viewed where 
not obscured by said final image; a projector to display the final image onto the screen; and a video 
source providing a final image to the projector, the final image having at least one object moving at 
perceptual speed upon said screen. 

[0015] According to yet another asjiect of the present invention, there is provided a method of 
having the human visual perception system perceive an observed image of at least one object on a two 
dimensional display at a target location as a three dimensional image, comprising the steps of: (i) 
moving the at least one object in the image such that a point on the at least one object along a plane of 
the expected viewers eyes occurs at a perceptual speed; (ii) applying visual highlights to the at least one 
object in the image, the visual highlights including specular highlight and shadows appropriate for the 
object at the target location; and (iii) obtaining a wide angle image of the surroundings of the target 
location and applying this wide angle image as a reflection map to the final image of the at least one 
object. 

(0016) The present invention provides significant advantages over two dimensional displays for 
purposes such as advertising and marketing, museimi displays, educational system, etc. wherein the 
extra attention that a three dimensional display can attract will be most beneficial. By producing a final 
image which has been tailored to exploit appropriate characteristics of the human visual perception 
system, a simple yet effective display is obtained. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

(00171 Preferred embodiments of the present invention will now be described, by way of example 
only, with reference to the attached Figures, wherein: 

Figure 1 shows a flowchart of the method of forming a final image in accordance with the 
present invention; 

Figure 2 shows a schematic representation of a possible display site for a final display produced 
in accordance with the method of Figure 1; 

Figure 3 shows the schematic representation of Figure 2 also including a background projector, 

Figure 4 shows a top view of a display system in accordance with another embodiment of the 
present invention; and 

Figure 5 shows a side view of the embodiment of Figure 4. 

DETAILED DESCRIPTION OF THE INVENTION 

[0018] The present inventor has determined that, by exploiting characteristics of the human visual 
perception system, a display of a properly constructed and displayed two dimensional moving image 
can be perceived by viewers as a three dimensional display, without requiring the viewers to use special 
viewing hardware. 

10019] Specifically, the present invoition employs the fiict the human visual perception system will, 
under certain conditions, perceive the display of a moving object displayed in finont of a background as 
being three dimensional, provided that sufficient movement, either rotation or translation, of the object 
occurs and that certain other conditions are met. It is believed that this occurs due to the way the human 
visual perception system detects vertical edges of viewed objects for each eye. While not presently well 
understood by the inventor, it is believed that the processing by the human visual perception system of 
the vertical edges of the images viewed by each eye results in a perception of three dimensional parallax 
when viewing a displayed two-dimensional object undergoing sufficient movement in front of a 
background. 

100201 The present invention can also further enhance the perception of three dimensionality 
experienced by viewers, by having the displayed object display visual highlights (e.g. - specular 
highlights, shadows, reflections of surroundings, etc.) that are appropriate for the object*s surroundings. 
[0021] As will be apparent, to exploit these characteristics, there are some limitations on the 
composition and positioning of the image to be displayed. Specifically, the above-mentioned 
characteristics of the himian visual perception system cannot be exploited to display still images as the 
image must move, either by rotating about an axis or by translating across the display or some 
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combination of both» at a sufficient rate as discussed below. Further, advantageously objects to be 
displayed should have at least portions of their surface likely to create visual highlights as they rotate or 
translate. Further still, if a displayed object passes off of the left or right side of the display screen, the 
perception of it being three dimensional tends to disappear and thus such movements should be avoided * 
if possible. Finally, the displayed object or set of objects must be displayed in front of a background 
which is visible to the viewer when viewing the displayed object. 

10022) However, by creative construction of the image, these limitations can be effectively dealt 
with. For example, if a displayed object is being rotated to provide the perception that is it three 
dimensional, the displayed object or set of objects can also be moved vertically, or can be translated 
while rotated, to maintain the viewer's visual interest in the display. Also, the viewpoint for the objects 
can be ''zoomed" in, or out, to accomplish some or all of the sufficient rate of movement. Also, an 
object which does not have the desirable surface characteristics to display visual highlights can have 
other objects, such as logos, text, etc. with the desired surface characteristics included in the image with 
the displayed object. These other objects can also, themselves, be perceived as being three dimensional 
by moving at a sufficient rate and/or moving in front of or behind other displayed objects. Also, if a 
projected background image is used with the display, as described below, the object can be stationary 
while the background moves, as discussed further below. 

10023] As should now be apparent to those of skill in the art, by creative design and projection of 
the final display, successful results can be obtained in a variety of manners, without unduly limiting the 
displayed subject matter. 

|0024| Figure 1 shows a flowchart of a presently preferred method of creating an image for a two 
dimensional display, which will be perceived as displaying three dimensional objects. At step 100 the 
site at which the display is to be shown is examined and a location for the display is determined. Figure 
2 shows a schematic representation of a site 200 at which a display may be shown. Site 200 can be an 
area within a booth for the floor of a trade show, an area within a consumer store, a location within a 
museum, etc. 

(0025) In Figure 2, a location, hereinafter the ''target location'' has been selected an appropriate 
distance behind a screen 204 on which the finished image 208 is to be displayed. The target location is 
the location and viewing distance at which the objects will appear to be located when displayed on 
screen 204. For example, it may be that, as described below, the object, or objects, to be displayed 
appears to be located two feet behind screen 204. 

(0026] In a presently preferred embodiment of the invention, screen 204 is a clear rear projection 
screen, such as a HoloPro™ rear projection screen, sold by ProNova USD, Inc., Hoboken NJ. A 
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projector 212. which can be any suitable video projector, a motion picture projector, etc., is located 
behind and appropriately aimed at screen 204 such that an image 208 projected by projector 2 1 2 will be 
displayed on screen 204. Projector 212 can be connected to any suitable video source, such as a 
computer system, DVD or videotape player, film, etc. Screen 204 is transparent even while displaying 
the final image and thus observers of the final image can see through scieen 204, about the displayed 
objects, to observe the background behind screen 204. 

(00271 At step 104 of Figure 1 , a survey is performed of the site where the display is to be located. 
In diis survey, light sources which would create visual highlights on real objects located at the target 
location are identified and their location with respect to the target location and their output levels are 
recorded. While this step is not essential, especially if the objects of die final image to be displayed are 
not likely to experience visual highlights, it has been found to produce a better three dimensional effect 
in most cases. 

[0028] In Figure 2, ceiling lights 216, 220 and 224 and floor lamp 228 would be identified and 
their positions relative to the target location are recorded, along with their respective lighting levels at 
the target location. While it is preferred that a directional light meter be employed at the target location 
to determine the light received fiom each of the identified light sourx:es, this level of accuracy is not 
generally required and reasonable estimates of the amount of light received fiom each light source can 
be employed instead. Any identified colored light sources are also quantified with respect to their color 
in addition to their intensity. 

I0029I In the survey, it is only necessary to identify and consider light sources which will contribute 
enough light to create visual highlights at flie target location, hereinafter "light sources of interest". 
Thus, in Figure 2, ceiling light 232 has been omitted from the survey, as has floor lamp 236, as both of 
these light sources deliver too little light to the target location to create visual highlights at the target 
location. 

I0030I Also in the siu^ey, any objects which obscure part of a light soiuce of interest are identified. 
In Figure 2, pillar 240 is identified as it will obscure light from ceiling light 224 and floor lamp 228 
and the general geometry of pillar 240, the fact that it extends from floor to ceiling and has a width of 
one foot, is noted. As pillar 244 does not obscure any light source of interest, it is omitted fiom the 
sui^vey. 

100311 To simplify the survey process, it is also possible to merely consider objects and/or light 
sources within a volume of interest about the target location. In a present embodiment of the invention 
a sphere centered at the target location and with a ten foot radius has been successfiilly employed as a 
volume of interest within which to identify light sources and objects to be included in the survey. As 
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will be apparent to those of skill in the art, difTerent sized spheres of interest, or other volumetric shapes 
of interest, can be employed under differing conditions. For example, if the ceiling lights in Figure 2 
are high output gas discharge lamps (such as mercury vapor lamps) a sphere with a radius of larger than 
10 feet may be employed. Similarly, if the ceiling lights of Figure 2 are low level lights, such as 
dimmed halogen lights, or indirect lighting sources, a sphere with a radius of less than ten feet can be 
employed as these lights are unable or unlikely to result in visual highlights on a object displayed at the 
target location. 

|0032| General ly, the intent is to perform the survey within a volume of interest which encompasses 
all lights and/or objects which can create visual highlights on a real object located at the target location. 
If a light meter is employed to measure light levels received at the target location from various sources, 
then an appropriate volume can effectively be selected as objects of interest will be readily identifiable. 
100331 After the survey has been successfully completed, the process continues at step 108 where 
reflection information is captured at the target location. Specifically, a panoramic photograph is taken, 
centered at the taiget location, around a plane parallel to the floor of the location. This panoramic 
photograph can be captured with a commercially available panoramic camera or, as in a present 
embodiment of the invention, the panoramic photograph is constructed from a series of six or more 
overlapping photographs, taken from the target location at appropriate headings, such as 60 degree 
headings when six photographs are employed, and which are subsequently "stitched** together with a 
suitable software program, such as Adobe Photoshop™, MGUs Photo Vista™ or any other digital 
image processing software which provides this capability. As described below, this panoramic 
photograph will be utilized to add reflections to the final image of objects at the target location. 
[00341 While the use of a panoramic photograph is preferred, it is also possible to use a wide angle 
photograph of the area of interest about the target location covering less than a three hundred and sixty 
degree panorama. As reduced a photograph as one covering one hundred and eighty degrees has been 
successfully employed by the present inventor, and it is contemplated that even smaller photographs 
may be employed, but for the best results a full panoramic photograph is presently preferred. Again, 
while it is preferred to obtain and employ such a panoramic photograph to provide reflection 
information for the final display, in some circumstances, such as where the final display does not 
display reflections (e.g. - it has a matte or other non-reflective surface) this step can be omitted. 
[00351 At step 112, the process continues with capturing video of the object or objects to be 
displayed. There are presently two techniques for capturing video of an object to be displayed, the first 
technique for real objects and the second technique for virtual objects. 
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100361 If the objects to be displayed are real, then the survey information obtained in step 104 is 
used to construct a mocking stage. The mocking stage recreates the lighting conditions and effects of 
the objects of interest, such as pillar 240. which exist at the real target location such that, when the 
objects to be displayed are located at a target location on the mocking stage, they are subject to the 
visual highlights, including specular highlights, shadows, ambient light levels and colors and the other 
lighting characteristics to which they would be subject at the target location at the site. As will be 
apparent to those of skill in the art, the mocking stage need not be constructed on a 1 : 1 scale and can 
instead be scaled to a reasonable size, as needed, by scaling the physical relationships between the lights 
and objects of interest and the target location and by adjusting the lighting levels of the light sources on 
the mocking stage corresponding to the scale changes. 

I0037I The back of the mocking stage is provided with a chromakey back drop to allow for removal 
of the background from the captured video image which is important so that the viewers can see 
through screen 204 to the background behind the display except where the objects appear. As is known 
to those of skill in the art, chromakeying allows for the removal of undesired backgrounds or objects 
from video images, by removing any portion of an obtained image which has a specified color. Thus an 
object place in front of a blue, or green, etc. backdrop can be fibned and the background will be 
removed by the chromakey system. 

(00381 Once the mocking stage is constructed, the objects are placed at the target location of the 
mocking stage and the camera is placed at the location where screen 204 would be with respect to target 
location at die site. As will be apparent, the focal length of the lens on the camera is selected such that 
the fibned object will appear at the right size and at the desired distance behind screen 204 when 
projected. 

100391 If no survey has been performed, a general lighting set up can be employed for filming the 
objects. This general lighting set up preferably will produce some specular highlights on the objects, 
without producing effects that would be perceived by viewers as being obviously wrong, and providing 
required lighting levels for capturing the final images of the objects. 

10040] As mentioned above, the present inventor has determined that one factor in having the 
human visual perception system consider a displayed object as a three dimensional image, is movement 
of die object at a sufficient rate. The movement can be translation or rotation of the object about an 
axis extending generally perpendicularly to a plane extending between the intended viewer's eyes , or a 
combination of rotation and translation. 

100411 If desired, the axis of rotation can be less than perpendicular to the plane, by as much as 
forty degrees from perpendicular, although it is presently preferred that the axis of rotation be no more 
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than twenty Tive degrees from perpendicular for best results, but the minimum required rotational speed 
for the object, discussed below, increases as the axis departs from perpendicular as will be apparent to 
those of skill in the art. In most cases, the plane through the viewers eyes will be horizontal plane, 
although it may have different orientations if the viewers are not expected to be in an upright position, 
etc. 

(00421 A turntable or other mechanism is employed to rotate or translate the objects at the desired 
orientation and speed. This turntable, or other mechanism, is also colored such that it is removed from 
the captured video image by the chromakeying system. The rotational and/or translational velocity of 
the object, necessary to take advantage of the characteristics of the human visual perception system to 
make the object appear as three dimensional, can be determined empirically, for example by c^turing 
video of the object and displaying the result on screen 204. 

(00431 The present inventor has determined that a rotational velocity which results in a movement 
of the outer edges of the final projected image of the object moving at least S% of the size of the object, 
as measured parallel to a plane through the viewer*s eyes, per second is an approximate minimum 
rotational velocity, although other rotational velocities will be appropriate in other circumstances. In 
other words, if an object measures three inches across on the above-mentioned plane, the rotational 
velocity should be selected such that a point on the object will move 5% of those three inches, along the 
plane, in one second. In other words, a point on this object on the plane of the viewer's eyes should 
move about 0.1 S inches along the plane in one second. As will now also be apparent, if the object is 
rotating about an axis which is not perpendicular to the plane, the rotational velocity of the object 
required to achieve the movement of the outer edges of the object with respect to the plane, will be 
higher than the rotational velocity required if the rotational axis was perpendicular to the plane. 
(0044] While it is contemplated that values as low as 0.8% can work in some circumstances, for 
example with objects that fill a significant portion of screen 204 when displayed, the present inventor 
has determined that, for the best results, a value of at least about 3% is desired. In some cases, values 
as high as 10% can be employed, although more commonly values between 1% to 8% are believed to 
be optimal. 

(00451 If the object is translating, rather than rotating, values as low as 3% and as high as 1 2% can 
be employed, but it is preferred that values in the range of 4% to 6% be employed with 5% being 
believed to be optimal in many circumstances. At S%, a three inch wide object translating from one 
side to the other should move fast enough that its edges cover 0. IS inches in a second. If the object is 
both rotating and translating, the translation and rotation rates need to be selected such that a point on 
the edge of tlie object still moves at the selected desired rate (i.e. 5%) of the size of the object along the 
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plane of a viewer's eyes. Thus if the object is rotating clockwise about an axis orthogonal to the plane, 
so that the front of the object is rotating right to left, and the object is also translating right to left, the 
speed of the rotation is added to the speed of translation for an observed point on the object and each 
movement can be slower than would be required on its own. 

(00461 Conversely, if the object is rotating clockwise and translating left to right, the speed of the 
translation is subtracted firom the speed of the rotation and thus the speed of rotation would likely have 
to be increased to ensure that the desired movement, of for example about S%, is still obtained. 
10047] Once the required movement of the objects is arranged, the objects are captured with the 
camera as the objects are rotated and/or translated for the required period of time. The captured image 
is then processed by the chromakey system to remove the background, turntable and any other 
undesired components. 

10048] If multiple objects are to be displayed and it is inconvenient, or impractical, to capture them 
simultaneously with a camera (for example if different objects need to move at different speeds), the 
captare step can be repeated with various objects and the resulting captured video need then only be 
composited together in a conventional manner. 

10049] It should be noted that the above-mentioned requirements for translational and/or rotational 
movement of the objects is actually not an absolute, but is instead relative to the background in the 
viewer's visual field. Thus, if the background which will be visible to a viewer of the final display is 
moving, the object can be motionless if the background moves about S% relative to the size of the 
object along a plane extending through the viewer*s eyes. Moving backgrounds can be obtained in a 
variety of manners including physically moving the background or projecting a moving image onto a 
background wall or screen behind screen 204. 

[0050] For example, the above-mentioned three inch object can be motionless if a background wall 
covered with projected spots has those spots moving behind the object left to right or right to left at 
0. 15 inches (as visually perceived at the target location) per second. The required degree of movement 
between an object and a displayed background is relative and thus if both the background and the object 
are moving, only their net difference in their speed of movement must equal about 5%. In our example 
of the three inch object, if the background moves left to right at 0.06 inches per second, then the object 
would need to translate from right to left at 0.09 inches per second to achieve the desired rate of 
movement on 0.15 inches. 

[0051] If the objects to be displayed are not real, but are instead virtual objects comprising objects 
modeled and rendered by a three dimensional computer rendering system, such as Avid's SOFTIMAGE 
3D, Alias^ Maya, etc., a similar procedure to that described above for real objects is followed. 
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Specifically, either a general lighting configuration or, preferably, a lighting configuration that matches 
that determined in step 1 04 is defined for the rendering of the object models and any objects of interest, 
such as pillar 240 are also modeled and positioned in the lighting configuration for the rendering. The 
camera (i.e. - the rendering viewpoint) is defined at the target location in the rendering and an 
animation is then defined for the objects, the animation defining the rotation and/or translation of the 
object. The same conditions exist for the speed of movement of the virtual objects as discussed above 
for real objects. The animation of the objects is then rendered, under the defined lighting conditions, to 
capture the necessary video. 

|0052| This desired rate of movement of the object(s ) described above is referred to herein as 
''perceptual speed*' as this is the rate of movement required to have the viewer perceive the two 
dimensional final image as being a three dimensional one. 

I00S3I At step 1 16, a reflection map is applied to the captured video of the real or virtual object, 
the reflection map being constructed from the panoramic photograph obtained at step 108 and, when 
applied, results in reflections of objects and the surroundings at the target location of the site being 
visible on appropriate portions of the final displayed image of the object. In the case of a real object, 
the reflection map is created fiom the panoramic photograph and applied to the captured video of the 
object with commercially available software, such as Combustion Studio or 
Adobe Photoshop. In the case of virtual objects rendered by a computer 3D animation system, the 
reflection map can be included in the rendering process. If a background is to be included in the final 
image, it can also be composited into the image at this point. Again, the mclusion of the reflection map 
is not an essential step of the present invention, especially where the object(s) to be displayed are 
incapable of displaying reflections, but it is a preferred step in that it increases the perception of the 
objects in the final display as being three dimensional. 

[00541 As mentioned above, the display of visual highlights (e.g. - specular highlights, reflections 
of surroundings, etc.) on the object in the final image that are appropriate for the object's surroimdings, 
exploits the characteristics of the human visual perception system such that the viewer will attempt to 
perceive the display as a three dimensional one. The combination of appropriate movement of the 
object in the final image and the presence of the correct visual highlights lead the viewer's visual 
perception system to see the final image as being three dimensional. 

[00551 Finally, at step 120, the resulting finished image 208 is projected, by projector 212 onto 
screen 204 at the site. The final image can be provided to projector 212 from a computer system, DVD, 
or can be rendered to film and projector 212 will be a motion picture projector, etc. 
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I0056I As mentioned above, it is presently preferred that screen 204 be a clear rear projection 
screen and thus the displayed image 208 is displayed flipped (miiror imaged) from the orientation it was 
captured in (this mirror imaging can be achieved by mechanical means - a mirror in the projection path 
- or via the image processing or animation software used to create the final image. However, it is also 
contemplated that front projection screens can be employed and, in such a case» no miiror imaging of 
the fmal image will be required. 

|0057| The embodiment discussed above contemplates a fmal image that has been prepared and 
created prior to showing the display. It is also contemplated that the fmal image can be created in real 
time, or near real time, in other circumstances. While the embodiment above provides good results, the 
overall effect can be further improved if the final image is created in real time to display visual 
highlights of the current environment of the display. For example, no viewing audience is included in 
the reflection map determined at step 108. As used herein, the term ''real time" is used generically to 
describe a situation wherein updates are provided within the bounds of the perception of the human 
visual perception system. It is not presently believed to be necessary to update visual highlights such as 
reflections more than about once every one or two seconds. 

10058] Accordingly, in a real time embodiment of the present invention, the reflection map, 
including the viewing audience and other surroundings, can be captured from one or morc cameras 
mounted about screen 204 and a new, updated, reflection map is crcated at appropriate intervals. This 
updated reflection map can then be applied to the captured video of the object, if it is a real object, or 
used to re-rcnder the object if it is a virtual object, and this updated image is then used as the final 
image on screen 204. As will be apparent to those of skill in the art, significant computational 
resources may be required to perform the processing of the final image to update the reflection map, but 
such resources are readily available and their costs are decreasing rapidly. 

(00591 In the embodiment of Figure 2, a single screen 204 and single projector 2 12 are provided 
which allows viewing of the fmal image over the viewing angle supported by screen 204. Figure 3 
shows the embodiment of Figure 2 wherein a second projector 260, which can be a video of motion 
picture projector, displays a moving image 264 onto the background which will be visible to viewers of 
the final image on screen 204. 

(00601 Figure 4 and 5 show another embodiment of the present invention wherein screen 204 
rotates and multiple projectors 2 1 2 are employed to provide appropriate fmal images over three hundred 
and sixty degrees of viewing. 

10061] Specifically, in this embodiment, screen 204 is mounted to the center of a dish-shaped 
turntable 300 which is rotatably mounted to motor 304 which rotates turntable 300. In a presently 
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preferred embodiment* tumtable 300 is rotated at an even multiple of the frame rate of the final image. 
If the final image has a frame rate of thirty fi:ames per, tumtable 300 is rotated at thirty revolutions per 
second, thus each projector 212 displays its image on screen 204 at its full frame rate. 
I0062I The outer edge 308 of tumtable 300 is inclined upwardly with respect to the base of 
tumtable 300 and an aperture 3 1 2 is provided through outer edge 308 behind screen 204. Projectors 
212 are inclined such that, when aperture 312 is in front of them, they can project an image through 
aperture 312 and on to screen 204. When aperture 312 is no longer in front of a projector 212, that 
projector's output is blocked by edge 308. 

(00631 In the illustrated embodiment, eight projectors 212 are provided, although only one is 
illustrated in Figure 5 for clarity, and as will be apparent to those of skill in the art, more or fewer 
projectors 2 1 2 can be employed as desired. If more projectors 2 1 2 are employed, it may be desired to 
vertically stagger the projectors and to provide additional, vertically and horizontally staggered 
apertures 3 1 2 in the edge 308 of tumtable 300 to allow the projectors to be physically mounted wittiin a 
reasonably small area. 

10064] To create a fmal image (either static or real time) for the embodiment of Figure 4 and S, the 
process described above, with reference to Figure I , is employed for the viewpoint of each projector 
212 to create the eight final images to be displayed. 

10065] It is presently preferred that aperture 3 12 be somewhat elliptical (having the major axis of 
the ellipse parallel to the base of tumtable 300) to ensure that the final image is projected from a 
projector 212 onto screen 204 through a reasonable portion of the rotation of screen 204. When the 
above-described HoloPro''^ rear projection screens are employed as screen 204, screen 204 can display 
a reasonable image when it is rotated as much as twenty two and a half degrees off axis from the 
centerline of a projector 212, thus allowing screen 204 to rotate through as much as forty five degrees 
while displaying the final image. While eight projectors 212 can thus provide project images for a full 
three himdred and sixty degrees of viewing, aperture 3 12 is preferably sized such that it rotates fix>m 
being in fix>nt of one projector 2 12 to being in fiiont of another projector 2 1 2, there is a period wherein 
the output of both adjacent projectors 212 is blocked. In this manner, no confusing overlap of two 
images occurs on screen 204 while tumtable 300 rotates. 

[0066] In a presently preferred embodiment, a viewing angle limiting screen 316, such as a vertical 
louver screen, is also positioned in fSront of screen 204. While not essential, screen 316 is presently 
preferred as it obscures the final image on screen 204 from viewers who are too far off the intended 
viewing angle of the final image on screen 204 and who might otherwise experience a less than 
satisfactory viewing. 
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(00671 The present invention is believed to provide significant advantages over two dimensional 
displays for purposes such as advertising and marketing, museum displays, educational system, etc. 
wherein the extra attention that a three dimensional display can attract will be most beneficial. By 
producing a final image which has been tailored to exploit appropriate characteristics of the human 
visual perception system, a simple yet effective display is obtained. 

10068] The above-described embodiments of the invention are intended to be examples of the 
present invention and alterations and modifications may be effected thereto, by those of skill in the art, * 
without departing from the scope of the invention which is defined solely by the claims appended 
hereto. 



